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Abstract 

This paper considers the maximization of information rates for the Gaussian frequency-selective 
interference channel, subject to power and spectral mask constraints on each link. To derive decen- 
tralized solutions that do not require any cooperation among the users, the optimization problem 
is formulated as a static noncooperative game of complete information. To achieve the so-called 
Nash equilibria of the game, we propose a new distributed algorithm called asynchronous itera- 
tive waterfilling algorithm. In this algorithm, the users update their power spectral density in a 
completely distributed and asynchronous way: some users may update their power allocation more 
frequently than others and they may even use outdated measurements of the received interference. 
The proposed algorithm represents a unified framework that encompasses and generalizes all known 
iterative waterfilling algorithms, e.g., sequential and simultaneous versions. The main result of the 
paper consists of a unified set of conditions that guarantee the global converge of the proposed 
algorithm to the (unique) Nash equilibrium of the game. 

Index Terms: Game theory, Gaussian frequency-selective interference channel, Nash equilib- 
rium, totally asynchronous algorithm, iterative waterfilling algorithm. 

1 Introduction and Motivation 

In this paper we focus on the frequency selective interference channel with Gaussian noise. The capacity 
region of the interference channel is still unknown. Only some bounds are available (see, e.g., pQ 2 J for 
a summary of the known results about the Gaussian interference channel). A pragmatic approach that 
leads to an achievable region or inner bound of the capacity region is to restrict the system to operate 
as a set of independent units, i.e., not allowing multiuser encoding/decoding or the use of interference 
cancelation techniques. This achievable region is very relevant in practical systems with limitations on 
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the decoder complexity and simplicity of the system. With this assumption, multiuser interference is 
treated as noise and the transmission strategy for each user is simply his power allocation. The system 
design reduces then to finding the optimum Power Spectral Density (PSD) for each user, according to 
a specified performance metric. 

Within this context, existing works [4] — [15] considered the maximization of the information rates 
of all the links, subject to transmit power and (possibly) spectral mask constraints on each link. The 
latter constraints are especially motivated in adaptive scenarios, e.g., cognitive radio, where previously 
allocated spectral bands may be reused, but provided that the generated interference falls below speci- 
fied thresholds [3]. In [HE], a centralized approach based on duality theory was proposed to compute, 
under technical conditions, the largest achievable rate region of the system (i.e., the Pareto-optimal set 
of the achievable rates). Our interest, in this paper, is focused on finding distributed algorithms with 
no centralized control and no cooperation among the users. Hence, we cast the system design under the 
convenient framework of game theory. In particular, we formulate the rate maximization problem as 
a strategic non-cooperative game of complete information, where every link is a player that competes 
against the others by choosing the spectral power allocation that maximizes his own information rate. 
An equilibrium for the whole system is reached when every player is unilaterally optimum, i.e., when, 
given the current strategies of the others, any change in his own strategy would result in a rate loss. 
This equilibrium constitutes the celebrated notion of Nash Equilibrium (NE) |17| . 

The Nash equilibria of the rate maximization game can be reached using Gaussian signaling and 
a proper PSD from each user [9] — [12]. To obtain the optimal PSD of the users, Yu, Ginis, and Cioffi 
proposed the sequential Iterative WaterFilling Algorithm (IWFA) [6] in the context of DSL systems, 
modeled as a Gaussian frequency-selective interference channel. The algorithm is an instance of the 
Gauss-Seidel scheme [18]: the users maximize their own information rates sequentially (one after the 
other), according to a fixed updating order. Each user performs the single-user waterfilling solution 
given the interference generated by the others as additive (colored) noise. The most appealing features of 
the sequential IWFA are its low- complexity and distributed nature. In fact, to compute the waterfilling 
solution, each user only needs to measure the noise-plus-interference PSD, without requiring specific 
knowledge of the power allocations and the channel transfer functions of all other users. The convergence 
of the sequential IWFA has been studied in a number of works [7], [H] — [15], each time obtaining milder 
convergence conditions. However, despite its appealing properties, the sequential IWFA may suffer from 
slow convergence if the number of users in the network is large, just because of the sequential updating 
strategy. In addition, the algorithm requires some form of central scheduling to determine the order in 
which users update their PSD. 

To overcome the drawback of slow speed of convergence, the simultaneous IWFA was proposed in 
[HIIIU [12]. The simultaneous IWFA is an instance of the Jacobi scheme [18]: at each iteration, the users 
update their own strategies simultaneously, still according to the waterfilling solution, but using the 
interference generated by the others in the previous iteration. The simultaneous IWFA was shown to 
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converge to the unique NE of the rate maximization game faster than the sequential IWFA and under 
weaker conditions on the multiuser interference than those given in [HE], [33] — [J_5] for the sequential 
IWFA. Furthermore, differently from [H EJ EH [J_5] , the algorithm as proposed in [TT] takes explicitly 
into account the spectral masks constraints. However, the simultaneous IWFA still requires some form 
of synchronization, as all the users need to be updated simultaneously. Clearly, in a real network with 
many users, the synchronization requirement of both sequential and simultaneous IWFAs goes against 
the non-cooperation principle and it might be unacceptable. 

This paper generalizes the existing results for the sequential and simultaneous IWFAs and develops 
a unified framework based on the so-called asynchronous IWFA, that falls within the class of totally 
asynchronous schemes of [18]. In this more general algorithm, all users still update their power alloca- 
tions according to the waterfilling solution, but the updates can be performed in a totally asynchronous 
way (in the sense of |18J). This means that some users may update their power allocations more fre- 
quently than others and they may even use an outdated measurement of the interference caused from 
the others. These features make the asynchronous IWFA appealing for all practical scenarios, either 
wired or wireless, as it strongly relaxes the need for coordinating the users' updating schedule. 

The main contribution of this paper is to derive sufficient conditions for the global convergence of the 
asynchronous IWFA to the (unique) NE of the rate maximization game. Interestingly, our convergence 
conditions are shown to be independent of the users' update schedule. Hence, they represent a unified 
set of conditions encompassing all existing algorithms, either synchronous or asynchronous, that can 
be seen as special cases of our asynchronous IWFA. Our conditions also imply that both sequential and 
simultaneous algorithms are robust to situations where some users may fail to follow their updating 
schedule. Finally, we show that our sufficient conditions for the convergence of the asynchronous IWFA 
coincide with those given recently in [TT] for the convergence of the (synchronous) sequential and 
simultaneous IWFAs, and are larger than conditions obtained in [HE], P3] — [E] for the convergence of 
the sequential IWFA in the absence of spectral mask constraints. 

The paper is organized as follows. Section [2] provides the system model and formulates the opti- 
mization problem as a strategic non-cooperative game. Section [3] contains the main result of the paper: 
the description of the proposed asynchronous IWFA along with its convergence properties. Section [4] 
recovers the sequential and simultaneous IWFAs as special cases of the asynchronous IWFA and then, 
as a by product, it provides a unified set of convergence conditions for both algorithms. Finally, Section 
[5] draws some conclusions. 

2 System Model and Problem Formulation 

In this section we clarify the assumptions and the constraints underlying the system model and we 
formulate the optimization problem addressed in this paper explicitly 
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2.1 System model 

We consider a Gaussian frequency-selective interference channel composed by multiple links. Since 
our goal is to find distributed algorithms that require neither a centralized control nor a coordination 
among the users, we focus on transmission techniques where interference cancelation is not possible 
and multiuser interference is treated by each receiver as additive colored noise. The channel frequency- 
selectivity is handled, with no loss of optimality, adopting a multicarrier transmission strategy!* Given 
the above system model, we make the following assumptions: 

A.l Each channel changes sufficiently slowly to be considered fixed during the whole transmission, so 
that the information theoretic results are meaningful; 

A. 2 The channel from each source to its own destination is known to the intended receiver, but not 
to the other terminals; each receiver is also assumed to measure with no errors the overall PSD of the 
noise plus interferences generated by the other users. Based on this information, each receiver computes 
the optimal power allocation across the frequency bins for its own transmitter and feeds it back to its 
transmitter through a low bit rate (error-free) feedback channel^] 

A. 3 All the users are block-synchronized with an uncertainty at most equal to the cyclic prefix length. 
This imposes a minimum length of the cyclic prefix that will depend on the maximum channel delay 
spread. 

We consider the following constraints: 
Co.l Maximum overall transmit power for each user: 

JV 

^{Klls} = I>«W ^ Np v Q = h---,Q, (i) 

k=l 

where s q contains the N symbols transmitted by user q on the N carriers, p q (k) = E ||sq(/c)| 2 | denotes 
the power allocated by user q over carrier k, and P q is power in units of energy per transmitted symbol. 
Co. 2 Spectral mask constraints: 



E 



{\s q (k)\ 2 }=p q (k)<p™ x (k), k = l,...,N, q = l,...,Q, (2) 



where p™ ax (fc) represents the maximum power that is allowed to be allocated on the A:-th frequency bin 
from the q-th user. Constraints like j2]) are imposed to limit the amount of interference generated by 
each transmitter over pre-specified bands. 

The main goal of this paper is to obtain the optimal vector power allocation p q = (p q (l), . . . ,p q (N)), 

for each user, according to the optimality criterion introduced in the next section. 

1 Multicarrier transmission is a capacity-lossless strategy for sufficiently large block length (21U22| . 

2 In practice, both measurements and feedback are inevitably affected by errors. This scenario can be studied by 
extending our formulation to games with partial information [231 124] . but this goes beyond the scope of the present 
paper. 
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2.2 Problem formulation as a game 

We consider a strategic non-cooperative game [SB [24], in which the players are the links and the payoff 
functions are the information rates on each link: Each player competes rationalbj^l against the others 
by choosing the strategy that maximizes his own rate, given constraints Co.l and Co. 2. A NE of the 
game is reached when every user, given the strategy profile of the others, does not get any rate increase 
by changing his own strategy. 

Using the signal model described in Section 12.11 the achievable rate for each player q is computed 
as the maximum information rate on the q-th link, assuming all the other received signals as additive 
colored noise. It is straightforward to see that a (pure or mixed strategy) NE is obtained if each user 
transmits using Gaussian signaling, with a proper PSD. In fact, for each user, given that all other users 
use Gaussian codebooks, the optimal codebook maximizing mutual information is also Gaussian [21] Q 
Hence, the maximum achievable rate for the q-th user is given by [21] 

1 N 

^ = ]v^ log(1 + sinr,?(/c)) ' (3) 

k=l 

with sinr g (A;) denoting the Signal-to-Interference plus Noise Ratio (SINR) on the k-th carrier for the 
q-th link: 



s\nr q (k) 



A 


H gq (k) 


\ 2 p q {k)/dl q A \H qq (k)\ 2 p q (k) 




H qr (k)\ 


2 Pr(k)/d7 q CT 2 q (k) +Y,rH \H gr (k)\ 2 Pr (k) 



(4) 



where H qr {k) denotes the frequency-response of the channel between source r and destination q ex- 
cluding the path-loss cQ r with exponent 7 and d qr is the distance between source r and destination 
q; cr 2 (k) is the variance of the zero mean circularly symmetric complex Gaussian noise at receiver q 
over the carrier k; and for the convenience of notation, we have introduced the normalized quantities 
H qr (k) = H qr (k)y/P r /d^ r and p q (k) = p q (k)/P q . 

Observe that in the case of practical coding schemes, where only finite order constellations can 
be used, we can use the gap approximation analysis [251 [26] and write the number of bits transmit- 
ted over the iV substreams from the q-th source still as in ([3]) but replacing \H qq (k)\ 2 in (|4j) with 
\H qq (k)\ 2 /T q , where T q > 1 is the gap. The gap depends only on the family of constellation and on 
P e<q ; for M-QAM constellations, for example, if the symbol error probability is approximated by 
P e , g (sinr 9 (A;)) « 4Q ( y/3smr q (k)/(M - 1)) , the resulting gap is T q = (Q~ l (P e j4)) 2 /3 [SUES]. 

In summary, we have a game with the following structure: 

& = {n,{& q } qeQ ,{R q } qe n}, (5) 

3 The rationality assumption means that each user will never chose a strictly dominated strategy. A strategy profile 
Xq is strictly dominated by z q if $ 9 (x 9 ,y_ 9 ) < <E> 9 (z 9 ,y_ g ) , for a given admissible y- 9 = (yi, . . . , y g _i,y q +i, . . . ,yQ) , 
where $ 9 denotes the payoff function of player q. 

4 Observe that, in general, Nash equilibria achievable using arbitrary non-Gaussian codes may exist. In this paper, we 
focus only on transmission using Gaussian codebooks. 
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where O = {1, 2, . . . , Q} denotes the set of the Q active links, £P q is the set of admissible (normalized) 
power allocation strategies, across the N available carriers, for the q-th player, defined aq3 



r i a 

4 p,£R W :-^p,(fc)=l, 0<p q (k)<i%**(k), k = l, 
I fe=l 



,N}, (6) 



with p g aax (k) = p q aax '(k)/P q and R q is the payoff function of the g-th player, defined in J3]). 

The optimal strategy for the ,-th player Jven the power allocation of the others, is then the 
solution to the following maximization problem_ 

1 N 

maximize — >log (1 + sinr„(£;)) 

p, qy , y q£ n (7) 



subject to p q £ & K 



where sinr g (fc) and & q and are given in and ([6]), respectively. Note that, for each q, the maximum 
in (JZJ) is taken over p q , for a fixed p- q = (pi, . . . , p,_i, p 9+ i, . . . , Pq) . 

The solutions of (j7]) are the well-known Nash Equilibria, which are formally defined as follows. 



Definition 1 A (pure) strategy profile p* = f p|, . . . , PqJ £ x . . . x «s a iVas/i Equilibrium of 
the qame <$ in @ if 

Rq&vP-q) > ^r(P ff ,P- g ), Vp, € £» ff , Vg 6 0. (8) 

Observe that, for the payoff functions defined in (|3j), we can indeed limit ourselves to adopt pure 
strategies w.l.o.g., as we did in ((H), since every NE of the game is proved to be achievable using pure 
strategies in [10J. 

According to J7|), all the (pure) Nash equilibria of the game, if they exist, must satisfy the waterfilling 
solution for each user, i.e., the following system of nonlinear equations: 



p* = WF g (p*,... ,p*_ 1} p* +1 ,..., p Q J =WF,(p%) , Vqtn, (9) 
with the waterfilling operator WFq (•) defined as 

^ q (k)+Y JrH \H qr (k)\ 2 p r (k) 



[WF,(p_ g )] fc 



A 



^ \H gg (k)\ 2 



k = l,...,N, (10) 



where [x] b a denotes the Euclidean projection of x onto the interval [a, 6]Q The water-level fM q is chosen 
to satisfy the power constraint (1/-/V) X^fc=iPg(^) = 1- 



5 In order to avoid the trivial solution p* q (k) = p™ ax (fc) for all k, XifcLi PtT^M > N is assumed for all q 6 £1 
Furthermore, in the feasible strategy set of each player, we can replace, without loss of generality, the original inequality 
power constraint (l/N) ~^2^ =1 Pq(k) < 1, with equality, since, at the optimum, this constraint must be satisfied with 
equality. 

6 In the optimization problem in |[7|), any concave strictly increasing function of the rate can be equivalently considered 
as payoff function of each player. The optimal solutions of this new set of problems coincide with those of J?]). 

7 The Euclidean projection [x] b a , with a < b, is defined as follows: [x] a = a, if x < a, [x] a = x, if a < x < b, and 
[xl = 6, if x > b. 
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Observe that in the absence of spectral mask constraints (i.e., when p™ ax (fc) = +00, Vg, V7c), the 
Nash equilibria of game are given by the classical simultaneous waterfilling solutions (6J [7], where 
WF g (•) in j9]) is still obtained from (fTO]) simply setting p q na,x (k) = +00, Vg, Vfc. Interestingly, the 
presence of spectral mask constraints does not affect the existence of a pure-strategies NE of game , 
as stated in the following. 

Proposition 1 The game in (EJj always admits at least one pure-strategy NE, for any set of channel 
realizations, power and spectral mask constraints. 

Proof. The proof comes from standard results of game theory [23j [24] and it is given in [10]. ■ 
In general, the game *S may admit multiple equilibria, depending on the level of multiuser interfer- 
ence [10]. In the forthcoming sections, we provide sufficient conditions ensuring the uniqueness of the 
NE and we address the problem of how to reach such an equilibrium in a totally distributed way. 

3 Asynchronous Iterative Waterfilling 

To reach the NE of game £f , we propose a totally asynchronous distributed iterative waterfilling proce- 
dure, which we name asynchronous Iterative WaterFilling Algorithm. The proposed algorithm can be 
seen as an instance of the totally asynchronous scheme of [IB]: all the users maximize their own rate 
in a totally asynchronous way. More specifically, some users are allowed to update their strategy more 
frequently than the others, and they might perform their updates using outdated information about 
the interference caused from the others. What we show is that the asynchronous I WFA converges to a 
stable NE of game §f , whichever the updating schedule is, under rather mild conditions on the multiuser 
interference. Interestingly, these conditions are also sufficient to guarantee the uniqueness of the NE. 

To provide a formal description of the asynchronous I WFA, we need to introduce some preliminary 
definitions. We assume, without any loss of generality, that the set of times at which one or more users 
update their strategies is the discrete set T = N + = {0,1,2,...}. Let denote the vector power 
allocation of user q at the n-th iteration, and let T q C T denote the set of times n at which user q 
updates his power vector p q (thus, implying that, at time n £ T q , p q is left unchanged). Let T?(n) 
denote the most recent time at which the interference from user r is perceived by user q at the n-th 
iteration (observe that T?{n) satisfies < Tr(n) < n). Hence, if user q updates its power allocation 
at the n-th iteration, then it waterfills, according to (TT01) . the interference level caused by the power 
allocations of the others: 

n (r«(n)) A ( n WW) (iiW) (^ + iW) (tSWA 

P-q — 1 Pi i'")P 9 _l >Pg+l ) - >Pq J- K xl ) 

The overall system is said to be totally asynchronous if the following weak assumptions are satisfied 
for each q [18] : Al) < r T ?(n) < n; A2) lim^oo (n&) = +00; and A3) \T q \ = 00; where {n^} is a 
sequence of elements in T q that tends to infinity. Assumptions Al— A3 are standard in asynchronous 
convergence theory [18] . and they are fulfilled in any practical implementation. In fact, Al simply 
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( T q( n \\ 

indicates that, at any given iteration n, each user q can use only the interference vectors p_ g 
allocated by the other users in the previous iterations (to preserve causality). Assumption A2 states 

that, for any given iteration index n&, the values of the components of p^Z q in (fTTI) generated prior 

(n) 

to nk, are not used in the updates of Pq , when n becomes sufficiently larger than n^; which guarantees 
that old information is eventually purged from the system. Finally, assumption A3 indicates that no 
user fails to update its own strategy as time n goes on. 

Given game 5f , let P™ m C {1, • • ■ , N} denote the set {1, . . . , N} (possibly) deprived of the carrier 
indices that user q would never use as the best response set to any strategies adopted by the other 
users [10J: 

Vf n 4 {k G {1, . . . , N} : 3 p_, G &>_ q such that [WF, (p_,)] fc + 0} , (12) 

with WFq (•) defined in {THJ) and 4 cp x x • • • x &> q _ x x x • • • x @> Q . In [10], an iterative 

procedure to obtain a set V q such that CP,C{1,- , A} is given. Let the matrix S max Glf Q 
be defined as 

\H qr (k)\ d2q P r 

max — = — - — —7- —py — — - , 11 r ^ q 

[S max ] ar 4 <( kev q nv r \H qq {k)\> <T qr P q ^ (13) 

0, otherwise, 



with the convention that the maximum in (|13p is zero if T> q n £> r is empty. In (|13p , each set X> g can 
be chosen as any subset of {1, • • • , N} such that £>™ in C V q C {1, • • • , N}, with £>™ in defined in (fill . 
Using the above notation, the asynchronous IWFA is described in Algorithm 1 (where N; t denotes the 
number of iterations). 

Algorithm 1: Asynchronous Iterative Waterfilling Algorithm 

Set n = and p^ = any feasible power allocation; 
f or n = : N it , 



p (n+l) 



WF ( p (r ' (n)) p (T - l(n)) p (T ' +l(n)) p (T « (n)) ) if „ G T 
p ? , otherwise; 



Vg G ft 
(14) 



end 



The convergence of the algorithm is guaranteed under the following sufficient conditions. 
Theorem 1 Assume that the following condition is satisfied: 

p(S max )<l, (CI) 
where S max is defined in fjjjj) and p(S max ) denotes the spectral radiu^ o/S max . Then, as N it — > 00 , 



8 The spectral radius p (S) of the matrix S is defined as p (S) = max {|A| : A G eig (S)}, with eig (S) denoting the set 
of eigenvalues of S |27| . 



the asynchronous IWFA described in Algorithm 1 converges to the unique NE of game ^ , for any set 
of feasible initial conditions and updating schedule. 



Proof. The proof consists in showing that, under JUT]), conditions of the Asynchronous Convergence 
Theorem in [18] are satisfied. A key point in the proof is given by the following property of the multiuser 
waterfilling mapping WF (p) = (WF g (p-g)) ?g Q based on the interpretation of the waterfilling solution 
(fTUj) as a proper projector [TT] : 



WF(p {1) ) - WF(p (2) ) <(3 p (1) -p (2) , Vp (1) , p (2) e & , (15) 



where ||-|| is a proper vector norm and f3 is a positive constant, which is less than 1 if condition (IC1|) 
is satisfied. See Appendix lAl for the details. ■ 

To give additional insight into the physical interpretation of the convergence conditions of Algorithm 
1 , we provide the following corollary of Theorem [TJ 

Corollary 1 A sufficient condition for It CI}) in Theorem is given by one of the two following set of 
conditions: 

1^ f \H qr (k)\ 2 \ cf qq P r „ 



-E 



S»„ \ T^tS) < 1. Vr G n, (C3) 



w r ^ kev r nv q \ \H qq (k)\ 2 J P g 



where w = [wi, . . . , u)q] is any positive vector. 

Note that, according to the definition of V q in (fT3j) . one can always choose T> q = {1, . . . , N} in (IC1|) 
and (|C2p - (|C3h . However, less stringent conditions are obtained by removing unnecessary carriers, i.e., 
the carriers that, for the given power budget and interference levels, are never going to be used. 

Recall that, if finite order constellations are used, Theorem[T]is still valid using the gap-approximation 
method [25j [26] as pointed out in Section l2~2l It is sufficient to replace each \H qq (k)\ 2 in (|Cip with 

\H qq (k)\ 2 /r q . 

Remark 1 - Global convergence and robustness of the algorithm: Even though the rate 
maximization game in (|7|) and the consequent waterfilling mapping (llOp are nonlinear, condition (ICip 
guarantees the global convergence of the asynchronous IWFA. Observe that Algorithm 1 contains as 
special cases a plethora of algorithms, each one obtained by a possible choice of the scheduling of 
the users in the updating procedure (i.e., the parameters {rr(n)} and {T q }). The important result 
stated in Theorem Q] is that all the algorithms resulting as special cases of the asynchronous IWFA are 
guaranteed to reach the unique NE of the game, under the same set of convergence conditions (provided 



9 The optimal positive vector w in (|C2 [) - (|C3|) is given by the solution of a geometric programming, as shown in [TT] 
Corollary 5] 
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that Al— A3 are satisfied), since condition (ICip does not depend on the particular choice of {T q } and 
K 9 (n)}. 

Remark 2 - Physical interpretation of convergence conditions: As expected, the convergence of 
the asynchronous IWFA and the uniqueness of NE are ensured if the interferers are sufficiently far apart 
from the destinations. In fact, from (|C2|) - (|C3l) one infers that, for any given set of channel realizations 
and power constraints, there exists a distance beyond which the convergence of the asynchronous IWFA 
(and the uniqueness of NE) is guaranteed, corresponding to the maximum level of interference that may 
be tolerated by each receiver [as quantified, e.g., in (IC2|> ] or that may be generated by each transmitter 
[as quantified, e.g., in (1C3|) ], But the most interesting result coming from (|C1|) and (1C2|) - (|C3I) is that 
the convergence of the asynchronous IWFA is robust against the worst normalized channels \H qT (k)\ 2 / 
\H qq (k)\ 2 ; in fact, the subchannels corresponding to the highest ratios \H qr (k)\ 2 /\H qq {k)\ 2 (and, in 
particular, the subchannels where \H qq (k)\ 2 is vanishing) do not necessarily affect the convergence of 
the algorithm, as their carrier indices may not belong to the set V q . 

Remark 3 - Distributed nature of the algorithm: Since the asynchronous IWFA is based on the 
waterfllling solution (fTUj) . it can be implemented in a distributed way, where each user, to maximize 
his own rate, only needs to measure the PSD of the overall interference-plus-noise and waterfill over it. 
More interestingly, according to the asynchronous scheme, the users may update their strategies using 
a potentially outdated version of the interference. Furthermore, some users are even allowed to update 
their power allocation more often than others, without affecting the convergence of the algorithm. 
These features strongly relax the constraints on the synchronization of the users' updates with respect 
to those imposed, for example, by the simultaneous or sequential updating schemes. 
We can generalize the asynchronous IWFA given in Algorithm 1 by introducing a memory in the 
updating process, as given in Algorithm 2. We call this new algorithm smoothed asynchronous IWFA. 



Algorithm 2: Smoothed Asynchronous Iterative Waterfilling Algorithm 



Set n 


= and Pq°^ = 


- any feasible power allocation and a q S [0, 1), Vq 6 ft; 






for n 


= : N it , 










p[ n+ 1] = | 


f a qPq n) + (1 - «,)WF 9 ( P L r ; (n)) ) , if n € T q , ^ 
i p q n \ otherwise, 


'q e ft; 


(16) 


end 











Each factor a q € [0, 1) in Algorithm 2 can be interpreted as a forgetting factor: The larger a q 
is, the longer the memory of the algorithm is0 Interestingly the choice of a q s does not affect the 

10 In this paper, we are only considering constant channels. Nevertheless, in a time-varying scenario, I]1GP could be used 
to smooth the fluctuations due to the channel variations. In such a case, if the channel is fixed or highly stationary, it is 
convenient to take a q close to 1; conversely, if the channel is rapidly varying, it is better to take a small a q . 
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convergence capability of the algorithm (although it may affect the speed of convergence [H]), as proved 
in the following. 

Theorem 2 Assume that condition of Theorem [7] is satisfied. Then, as N; t — > oo, the smoothed 
asynchronous IWFA described in Algorithm 2 converges to the unique NE of game , for any set of 
feasible initial conditions, updating schedule, and {a g } ge n ; with a q € [0, 1) , \fq € 

Proof. See Appendix lAl ■ 

Remark 4 - Asynchronous IWFA in the presence of intercarrier interference: The proposed 
AI WFA can be extended to the case where the transmission by the different users contains time and 
frequency synchronization offsets. In [HI [20] we showed that the Asynchronous IWFA is robust against 
the intercarrier interference due to time and/or frequency offsets among the links and we derived 
sufficient conditions guaranteeing its convergence in the presence of such time/frequency misalignments. 

4 Two Special Cases: Sequential and Simultaneous IWFAs 

In this section, we specialize our asynchronous IWFA to two special cases: the sequential and the 
simultaneous IWFAs. As a by-product of the proposed unified framework, we show that both algorithms 
converge to the NE under the same sufficient conditions, that are larger than conditions obtained for 
the convergence of the sequential IWFA in [BJ [7], [H], [15J (without considering the spectral mask 
constraints) and [14] (including the spectral mask constraints). 

Sequential Iterative Waterfilling: The sequential IWFA is an instance of the Gauss-Seidel scheme 
by which each user is sequentially updated [18] based on the waterfilling mapping (fTQl) . In fact, in 
sequential IWFA each player, sequentially and according to a fixed order, maximizes his own rate 
J3|), performing the single-user waterfilling solution in (fTQl) . given the others as interference. This 
scheme can also be seen as a particular case of the general asynchronous IWFA with the following 
parameters: T q = {kQ + q, k € N+} = {q, Q + q, 2Q +?,...} and Tr(n) = n, Vr, q. Using this settings 
in Algorithm 1, the sequential IWFA can be written in compact form as in Algorithm [3l 



Algorithm 3: Sequential Iterative Waterfilling Algorithm 



Set n 


= and p q °^ = any feasible power allocation; 






for n 


= 0:N it , 








p (n+l) _ f WF « (P-J) . if ( n + !) mod Q = 9, 
1 p q , otherwise, 


Vg G 0; 


(17) 


end 
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Simultaneous Iterative Waterfilling: The simultaneous IWFA can be interpreted as the syn- 
chronous Jacobi instance of the asynchronous IWFA. In fact, in the simultaneous IWFA, all the users 
update their own covariance matrix simultaneously at each iteration, performing the single user water- 
filling solution (|10p . given the interference generated by the other users in the previous iteration. This 
is a particular case of the asynchronous IWFA in Algorithm 1 with the following parameters: T q = N+, 
and Tr(n) = n, W, q, which leads to Algorithm [H 

Algorithm 4: Simultaneous Iterative Waterfilling Algorithm 

Set n = and = any feasible power allocation; 
f or n = : N it , 

p(" +1 )=WF g (p ( . r ; ) ), Vqtn; (18) 
end 

By direct product of our unified framework, invoking Theorem Q] we obtain the following unified set 
of convergence conditions for both sequential and simultaneous IWFAs |llj . 

Theorem 3 Assume that condition \C1\) of Theorem^ is satisfied. Then, as Nit — > oo, the sequential 
and simultaneous IWFAs, described in Algorithm^ and^ respectively, converge geometrically to the 
unique NE of game & for any set of feasible initial conditions and updating schedule. 

Remark 5 - Algorithm robustness: It follows form Theorem [3] that slight variations of the 
sequential or simultaneous IWFAs that fall within the unified framework of the asynchronous IWFA, 
are still guaranteed to converge, under the condition in Theorem [H This means that, using for example 
Algorithm 02 if the order in the users' updates changes during time, or some user skips some update, 
or he uses an outdated version of the interference PSD, this does not affect the convergence of the 
algorithm. What is affected is only the convergence time. Moreover, as for the smoothed asynchronous 
IWFA, also for the sequential and simultaneous IWFAs described in Algorithm [3] and 3J respectively, one 
can introduce a memory in the updating process [llj, still guaranteeing convergence under conditions 
of Theorem [3l 

Remark 6 - Comparison with previous convergence conditions: Algorithm 03 generalizes 
the well-known sequential iterative waterfilling algorithm proposed by Yu et al. in [6] to the case 
where the spectral mask constraints are explicitly taken into account. In fact, the algorithm in [6] 
can be obtained as a special case of Algorithm OH by removing the spectral mask constraints in each 
set & q in ([6]), (i.e. setting p q nax {k) = +oo, Vk,q), so that the waterfilling operator in (fTOjl becomes 
the classical waterfilling solution [21], i.e., WFg (p_ ? ) = (/i 9 ljv — insr g ) + , where (x) + = max(0,a;) 
and insr 9 = [insr g (l), . . . , insr 9 (A)] T , with insr 9 (/c) = (al q (k) + J2r^ q \ H qr{k)\ 2 p r (k))/ \H qq (k)\ 2 . The 
convergence of the sequential IWFA has been studied in a number of works, either in the absence 
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El [H EJ E] or in the presence [IU [14] of spectral mask constraints. Interestingly, conditions in 
[SI El El El E] and [14] imply our condition (IC1|) . which is more relaxed as shown next. Let 

-ir A I -i Qmax\— 1 c max /-i n \ 
1 - I 1 ~ & low ) s upp ' l iy J 

with and Sj^p denoting the strictly lower and strictly upper triangular part of the matrix s max ; 

respectively, and S max is defined similar to S max in (fl~3j) . but taking the maximum over the whole set 
{1, . . . , N}. The relationship between (sufficient) conditions for the convergence of sequential I WFA as 
derived in El El El El E] and condition (IClfl is given in the following corollary of Theorem (3) 



Corollary 2 Sufficient conditions for fCij) in Theorem 1 are JEj—JB 



1 1 rq { k I " 1 dqq P r ^ 1 



or 



ma x { \ T -r , 9 t ~r~FT < T\ 7> Vr,qen,q^r, (C4) 



, t H rq (k)\ 2 \ d- gPr 1 
max ,„ in /,M9 ^TTT < 7^, o' Vr,g£f),^r, (C5) 



or 



ke{i,...,N} {\H gq {k)\ 2 j d%P q 2Q-3' 

p(T)<l, (C6) 



where T is defined in fTgj) . 

Proof. See Appendix [Bl ■ 

Since the convergence conditions in Corollary [2] depend on the channel realizations |ff gr (fc)} and 
on the distances {d qr } , there is a nonzero probability that they are not satisfied for a given channel 
realization, drawn from a given probability space. To compare the range of validity of our conditions 
vs. the conditions available in the literature, we tested them over a set of channel impulse responses 
generated as vectors composed of L = 6 i.i.d. complex Gaussian random variables with zero mean and 
unit variance (multipath Rayleigh fading model). Each user transmits over a set of N = 16 subcarriers. 



We consider a multicell cellular network as depicted in Figure 1(a) , composed by 7 (regular) hexagonal 
cells, sharing the same band. Hence, the transmissions from different cells typically interfere with each 
other. For the simplicity of representation, we assume that in each cell there is only one active link, 
corresponding to the transmission from the base station (BS) to a mobile terminal (MT) placed at a 
corner of the cell. According to this geometry, each MT receives a useful signal that is comparable, in 
average sense, with the interference signal transmitted by the BSs of two adjacent cells. The overall 



network is modeled as a set of seven wideband interference channels. In Figure 1(b), we plot the 



11 Recall that condition l|Cip guarantees also the convergence of the more general asynchronous IWFA, as stated in 
Theorem [l] 

12 In [6], the authors derived conditions l|C4p for a game composed by Q — 2 users and in the absence of spectral mask 
constraints. 
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(a) Multicell cellular system (b) Probability of (IC 111 . (IC4I) and llC6ll versus r. 

Figure 1: Probability of (|Cip . (|C4[) and (jC6|) versus r [subplot (b)] for a 7 cell (downlink) cellular system 
[subplot (a)]; Q = 7 , N = 16, 7 = 2.5, P 9 = P r , r 9 = 1, P q ja\ = 7dB, Vr, g £ 0, and w = 1. 



probability that conditions (jCljl . (|C4j) and (|C6|) are satisfied versus the (normalized) distance r G [0, 1) 
(see Figure 1(a)), between each MT and his BS (assumed to be equal for all the MT/BS pairs). We 
tested our conditions considering the set T> g , obtained using the algorithm described in |10j . 

As expected, the probability of guaranteeing convergence increases as each MT approaches his BS 
(i.e., r — > 1). What is worthwhile noticing is that our condition (|Cljl significantly enlarges (IC4[) and 
(|C6| . since the probability that (IClj) is satisfied is always much larger than (|C4j) and (1C6|) . 



Remark 7 - Sequential versus simultaneous IWFA: Since the simultaneous IWFA in Algorithm 
H] is still based on the waterfilling solution (PTOl) . it keeps the most appealing features of the sequen- 
tial IWFA, namely its low-complexity and distributed nature. In addition, it allows all the users to 
update their optimal power allocation simultaneously. Hence, the simultaneous IWFA is faster than 
the sequential IWFA, especially if the number of active users in the network is large. A quantitative 
comparison between the sequential and simultaneous IWFAs, in terms of convergence speed, is given 
in [TT]. In [19], we also provided a closed form expression of the error estimates as a function of the 
iteration index, obtained by the sequential and simultaneous IWFAs. 



5 Conclusion 

In this paper, we have studied the maximization of the information rates for the Gaussian frequency- 
selective interference channel, given constraints on the transmit power and the spectral masks on each 
link. We have formulated the optimization problem as a strategic noncooperative game and we have 
proposed a novel, totally asynchronous iterative distributed algorithm, named asynchronous IWFA, 
to reach the Nash equilibria of the game. This algorithm contains as special cases the well-known 
sequential IWFA and the recently proposed simultaneous IWFA, where the users update their strategies 
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sequentially and simultaneously, respectively. The main advantage of the proposed algorithm is that no 
rigid scheduling in the updates of the users is required: Users are allowed to choose their own strategies 
whenever they want and some users may even use an outdated version of the measured multiuser 
interference. This relaxes the coordination requirements among the users significantly. Finally, we 
have provided the conditions ensuring the global convergence of the asynchronous IWFA to the unique 
NE of the game. Interestingly, our convergence conditions do not depend on the specific updating 
scheduling performed by the users and, hence, they represent a unified set of convergence conditions 
for all the algorithms that can be seen as special cases of the asynchronous IWFA. 

Appendix 

A Proof of Theorems [Tj and [2] 

We start with some definitions and intermediate results that will be instrumental to prove Theorems [JJ 
and [3 

Properties of the waterfilling mapping. For technical reasons, we define the admissible set 
= &>f x • • • x @><^ C where 

&f ± {p q € & q with Pq (k) =0Vk£V g }, (20) 

is the subset of & q containing all the feasible power allocations of user q, with zero power over the 
carriers that user q would never use in any of its waterfilling solutions (fTUj) . against any admissible 
strategy of the others. Observe that the game does not change if we use <$^ eff instead of the original & . 
For any given {a q } qe n, with a q G [0, 1), let T(p) = (T g (p)) en : <P eS h^ £P eB be the mapping defined, 
for each q, as 

T,(p) = a q Pq + (1 - a,)WF, (p_ 9 ) , P G^ eff , (21) 

where \NF q (p_ 9 ) : 3F^ q \-* & e q is the waterfilling operator defined in (fTUl) . Observe that all the Nash 
equilibria of game £f correspond to the fixed points in £P eS of the mapping T in (|2T1) . Hence, the 
existence of at least one fixed point for T is guaranteed by Proposition [TJ 

Given T in (|2~T1) and some w = [w q , . . . , wq] t > 0, let || "Unblock denote the (vector) block-maximum 
norm, defined as 1181 



I|T(P)||- W0ck ^maxi^4, (22) 
' <?esz w q 

where ||-|| 2 is the Euclidean norm. Let INI™ vec be the vector weighted maximum norm, defined as |27j 

l|xC vec = max^, w>0, x£l« (23) 



and let ||-||™ mat denote the matrix norm induced by ||-||™ vec , defined as [27 



|A||- mat 4 m a X ±-<T[A] qr w r , A G R^. (24) 



1 Wq 



r=l 
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Finally, we introduce the matrix S™ ax , denned as 

S£ ax = D a + (I - D Q )S max , with D Q 4 diag(a g . . . a Q ), (25) 

where S max is defined in (fT3l) . The block-contraction property of mapping T in (f2Tl) is given in the 
following theorem that comes directly from [111 Proposition 2]. 

Theorem 4 (Contraction property of mapping T) Given w = [wi, . . . ,wq] t > and {a q } q< =n, 
with a q € [0, 1), the mapping T defined in $21}) satisfies 



T(pW)-T(p 



(2)> 



2,block 



— Il^a I loo, mat 



pd) _ p (2) 



2,block 



, Vp^, p( 2 ) € & eS , (26) 



where 



Zblocki HZ, ma t andSr x are defined m » Ml and M>, respectively. If\\S^\\Z, m ,t < 1, 

w 

oo,mat " 



then mapping T is a block- contraction with modulus ||S™ ax||w 



Asynchronous convergence theorem [18]. Let X\, X2,...,Xq be given sets, and let X be their 
Cartesian product, i.e., 

X = X x x X 2 x ... x X Q . (27) 

Let i q : X t— > X q be a given vector function and let f : X i— > X be the mapping from X to X, defined 
as f (x) = ffi(x), . . . ,fg(x)^ , and assumed to admit a fixed point x* = f(x*). Consider the following 
distributed asynchronous iterative algorithm to reach x* 



x 



(n+1) 



x 



(n) 
q ; 



(28) 



otherwise, 



with < Tr{n) < n and T q denoting the set of times n at which x^ is updated and satisfying Al— A3 
of Section 03 Assume that: 

C.l (Nesting Condition) There exists a sequence of nonempty sets {X(n)} with 

... C X(n + 1) C X(n) C ... C X, (29) 

satisfying the next two conditions. 

C.2 (Synchronous Convergence Condition) 

f(x)€#(n+l), Vn, and x eA'(n). (30) 

Furthermore, if {y^} is a sequence such that y^£X(n), for every n, then every limit point of 
{yW} is a fixed point of f(-). 

C.3 (Box Condition) For every n there exist sets X q (n) C X q such that 

X(n) = X^n) x ... x X Q (n). (31) 
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Then we have the following . 

Theorem 5 ( |18L Proposition 2.1]) If the Synchronous Convergence Condition (Slfy and the Box 
Condition 1131]) are satisfied, and the starting point x.^ = ^x[°\ . . . , XqM of the algorithm 128\) belongs 
to X(0), then every limit point of {x( n )} given by t2tfy is a fixed point of f ( ■ ). 

We are now ready to prove Theorems 1 and 2 through the following two steps: 
Step 1. We first show that the asynchronous IWFA in Algorithms 1 and 2 is an instance of the totally 
asynchronous iterative algorithm in 1(28]) . Then, using Theorem 3J we derive sufficient conditions for 
C.1-C.3. 

Step 2. Invoking Theorem (H we complete the proof showing that the asynchronous IWFA converges 
to the unique NE of Sf from any starting point, provided that condition (|Cip is satisfied. 

Step 1. It is straightforward to see that the asynchronous IWFA coincides with the algorithm given in 
1(28]) . under the following identifications 

x q & p q , x* ^ p* X q 

VqeU, (32) 

f g (x)^T g (p), 

X <=> &> eS = &f x ... x 

where @>f and T 9 (p) are defined in ((201) and (|2~T]) . respectively. Observe that, to study the convergence 
of the asynchronous IWFA, there is no loss of generality in considering the mapping T defined in 
cpeff (- op i n stead of since all the points produced by the algorithm (except possibly the initial 
point, which does not affect the convergence of the algorithm in the subsequent iterations) as well as 
the Nash equilibria of the game are confined, by definition, in ^ 2eff . 

We consider now conditions C.1-C.3 separately. 
C.l (Nested Condition) Let p* = ^p^, . . . , p^j G £? eS be a fixed point of T in (f2"T]) (or, equivalently of 

fq in ®) and p(°) = (pf\ . . . .pg)) G & eS be any starting point of the asynchronous IWFA. Using 
the block -maximum norm ||'||2 block ^ defined in (I22p . where w — [wi, . . . , w q ] is any positive vector, 
we define the set X(n) in ((29]) as 

X(n) = {p G ^ : ||p - pl^ck < n\P i0) ~ Pillock} c ^ 03) 

with 

/3 = /3(w,Sr x ) = l|Sr x C, (34) 
and S™ ax defined in {25]). It follows from JH that if 

r+ i|| p (0) _ p1 |w jock < ^UpCo) _ p*||w iock) V n = 0, 1, (35) 

then we obtain the desired result, i.e., 

X(n + 1) C X(n) C ^ eff , Vn = 0, 1, .... 
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A necessary and sufficient condition for (|35l) is 



P<1. 



(36) 



We will assume in the following that (|36|) is satisfied. 

C.2 (Synchronous Convergence Condition) Let p( n ) G A'(n). Then, from ([33]) . it must be that 



P 



in) 



2,block 



</3 n || P (0) - P 



* II w 

2,block- 



Let p( n+1 ) = T(p (n) ). Then, we have 



P 



w 

2,block 



T(p (n) )-P" 



2,block 



</3 



,(n) 



P 



2,block 



</3 n+1 ||pW -p* 



l2,block' 



(37) 



(38) 



where the first and the second inequalities follow from Theorem [4] (using (|26j) with p* = T (p*)) and 
J37}, respectively. Hence, p( n+1 ) g Af(n+ 1), as required in (j30l) . Furthermore, since 



lim 

n— >oo 



P 



2,block 



0, with p (n) G AT(n), Vn, 



the sequence {p^ n ^} generated from p(°) by the mapping T using the simultaneous updating scheme in 
([30]) must converge to p*. Moreover, it follows from (|36l) and Theorem |4] that the fixed point p* of T 
is unique (implied from the fact that the mapping T is a block-contraction [TBI Proposition 1.1]). 

C.3 (Box Condition) For every n, the set X(n) in (j33]) can be decomposed as X(n) = X\(n) x . . . x 
Xq(u), with 



XJn) 



p G ^efr . 1^ p gll 2 < (o) _ p * 



l2,block 



c 



2>eff 
9 ' 



Vg G fi. 



(39) 



5£ep 2. Under (|36l) . Theorem [5] is satisfied if the starting point p^ ) of the asynchronous IWFA is 
such that p(°^ G <^ eff . The asynchronous IWFA, as given in Algorithm 1 and Algorithm 2, is allowed 
to start from any arbitrary point p^ in S > . However, after the first iteration from all the users, the 
asynchronous IWFA provides a point in <^ eff , for any p^ ** G Hence, under (f36]l . the asynchronous 
IWFA satisfies Theorem [5] after the first iteration, which still guarantees that every limit point of 
the sequence generated by the asynchronous IWFA is a NE of the game . Since condition (|36) 
is also sufficient for the uniqueness of the NE [recall that, under (|36]l . the mapping T in (j2Tj) is a 
block-contraction], the asynchronous IWFA must converge to this unique NE. 

To complete the proof, we just need to show that (|C1|) is equivalent to ([36]) . Since in (j3"6]) each 



a q G [0, 1), we have 



P 



Smax |iw -i 
, a Woo < 1 ^ 



< 1. 



(40) 



Since S max is a nonnegative matrix, there exists a positive vector w such that [181 Corollary 6.1] 



<1 p(S max )<l. 



(41) 
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Since the convergence of the asynchronous IWFA is guaranteed under ([36]) . for any given w > 0, we 
can choose w =w and use (|4T1) . 

Conditions (|C2P - (|C3l) in Corollary Q] can be obtained as follows. Using [TBI Proposition 6.2e] 
p(S max ) < ||S max ||™,Vw > 0,a sufficient condition for the => direction in @]J is ||S max ||™ < 1, for 
some given w > 0; which provides (IC2j) . Condition (1C3|) is obtained similarly, still using (j4Tj) and 
p (S max ) = p (S maxT ) . ■ 

B Proof of Corollary [2] 

Since conditions [|C2l) -flC3 ]) imply jHU) (Corollary [JJ), the sufficiency of (C4} for (JOUl follows directly 
setting, in (IC2I) . P g = P r for all g, r, T> q = V r = {1, . . . ,N}, w = 1, and using the following upper 
bound \H r Jk)\ 2 /\H qq (k)\ 2 < max {\H rq (k)\ 2 /\H qq (k)\ 2 } . Observe that condition (1C5|) is stronger than 



(|C4p . and thus implies (ICljl . 

We prove now that condition (|C6|) is stronger than (|C1|) . To this end, it is sufficient to show that 
p(T) < 1 ^ p (S max ) < 1, where S~ max is defined after {£JJ, since S max < S~ max leads to p(S max ) < 
p (S max ) < 1 [28j Corollary 2.2.22] We first introduce the following intermediate definition and result 



Definition 2 A matrix A E R nxn is said to be a Z-matrix if its off-diagonal entries are all non-positive. 
A matrix A G M nxn is said to be a P-matrix if all its principal minors are positive. A Z-matrix that is 
also P is called a K.-matrix. 

Lemma 1 ([28, Lemma 5.3.14]) Let A G M nxn be a K.-matrix and B a nonnegative matrix. Then 
/9(A _1 B) < 1 if and only if A — B is a K.-matrix. 

According to Definition [2l I— S|^ ax is a Z-matrix. Since all principal minors of I— Sj^ ax are equal to 
one (recall that I— S^ ax is a lower triangular matrix with all ones on the main diagonal), I— Sj^ ax is also 
a P-matrix, and thus a K-matrix. Invoking Lemma Q] we obtain the following chain of equivalences 

p(T)<l o I -S max is a K-matrix o p(S max )<l, (42) 

where the first and the second equivalence follows from Lemma Q] using the correspondences A = 

IcT max -■-> T^max T -pq-max -pq-max T Tjmax , . t n n max 1 tx r n r 

— a low , r> = a upp , 1 — 55 low — b upp = 1 — b and A = 1, rJ = a , respectively It follows from 

([421 that p (T) < 1 <^ p (S max ) < 1 p (S max ) < 1; which completes the proof. ■ 
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